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The cumulant generating function 4>(n) and rate function £(/) of free energy is evaluated in 
the p-body Sherrington-Kirkpatrick model by the replica method with the finite replica number 
n. From a perturbational argument, we show that the cumulant generating function is constant 
in the vicinity of n = 0. On the other hand, with the help of two analytic properties of <j>(n), 
the behavior of 4>(n) is derived again. However, this is also shown to be broken at a finite value 
of n, which gives a characteristic value in the rate function near the thermodynamic value of 
the free energy. Through the continuation of <j>(n) as a function of n, we find a way to derive 
the 1RSB solution at least in this model, which is to fix the RS solution to be a monotonically 
increasing function. 
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1. Introduction 

The Replica Method (RM) is a tool to describe 
the statics of disordered systems. It has been ap- 
plied mainly to the mean-field models and suc- 
ceeded to provide many interesting concepts. How- 
ever, one has no idea why RM itself is a correct 
procedure in a mathematical sense and a satis- 
caftory answer to the problem has not yet been 
obtained. There are such problems as the choice 
of saddle point or the so-called "analytic contin- 
uation" . These problems are particularly difficult 
when you have to regard them as rigorous. Thus 
far, only the solvable models are studied 1 ' or the 
sufficient conditions of the uniqueness of the an- 
alytic continuation are examined. 2 ' On the other 
hand, the necessary condition for the continuation 
has not been extensively considered yet, except 
for ref. 3. Thus, as a first step toward a better 
understanding of the RM, we discuss these prob- 
lems through the p-body Sherrington-Kirkpatrick 
model. 4 -' 

Hereafter, we restrict our attention to the sys- 
tems that have quenched disorder and do not dis- 
cuss the models that do not have explicit random- 
ness, like structural glass. For a given disordered 
system with a Hamiltonian H at the inverse tem- 
perature /?, the formula of RM is written as 

[log 21 = lim -log[Z"], (1.1) 

n— >0 n 

where Z = Trexp(— f3H) and the bracket [• • •] de- 
notes the coiffigurational average with respect to 
the randomness in the system. The moment [Z n ] 



is evaluated relatively easily when n is an inte- 
ger. Then, the problem of RM is regarded as the 
continuation of the cumulant generating function 
(f>(n, N) :— — log[Z"] from the integer n greater 
than 1 to the vicinity of 0. Here, N denotes the 
system size. 

If the continuation for any real value of n is 
performed, all the information on the probabilistic 
fluctuation of log Z is obtained. 5 ' For instance, the 
variance of the free energy is derived as 

A (-log[Z n ]) =[(logZ) 2 ]-[logZ] 2 , 

and higher cumulants are also derived using cor- 
responding higher order derivatives. Note that an 
analytic property of in the vicinity of n = 
is significant to the probabilistic fluctuation of the 
free energy. In fact, this leads to the large devia- 
tion property of the free energy. 

Assuming that the self-averaging property for 
the free energy is held, the probability distribution 
function of log Z in the limit N — > oo is expressed 
as 



Pr(logZ«JV/)«expHVE(/)), 



(1.2) 



where £(/) is determined using the Legendre 
transformation, 



£(/)=n/-n#n), / = 



d(n(f>(n)) 
dn 



(1.3) 



with n<fi(n) := lirrijv^oo -^n(j}(n, N) = 
limjv-voo jf log[2™]. This is because the orig- 
inal large deviation property describes the 
probability distribution function of the statistical 
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average asymptotically: 

Pr ^logZ w w MiV/j w exp(-MATS(/)) 

as M, iV^oo, 

where ZW is the i.i.d. partition function. By set- 
ting / = jjlogZ, the formula to determine £(/) 
is derived by the saddle point method as 

log[Z"] = log f dfP(f)exp[nNf] 

= lo g yd/exp[J\r{n/ -£(/)}] 
« JVmax(n/ -£(/)). 

The large deviation property of the free energy 
is evaluated in ref. 6 for the two-body Shcrrington- 
Kirkpatrick model. In the present paper, we apply 
the framework of ref. 6 to the case of p-body in- 
teraction and see the similarity to ref. 7, in which 
the number of metastable states in the p-body SK 
model is evaluated. They are conceptually differ- 
ent but we have found that the way to study the 
large deviation property proposed in ref. 6 is the 
same as that to calculate the complexity proposed 
in ref. 8 for some cases. 

The organization of this paper is as follows. In 
§2, we introduce the model and formulate a calcu- 
lus of the cumulant generating function by RM 
with the replica number n finite. In §3, following 
ref. 6, we perform the perturbation for the cumu- 
lant generating function with respect to n around 
n = where the first-step replica symmetry break- 
ing (1RSB) ansatz is correct. In §4, we discuss the 
continuation between the RS solution for large n 
and the 1RSB solution for small n. In §5, the rate 
function E is explicitly calculated. Finally, §6 is 
devoted to our conclusions. 

2. Our Model and Replica Analyses 

The model Hamiltonian we discuss is given as 
1 



H 



Jii—ipSii " " " Sipi (2-1) 



»!<•••<*£ 



where Si = ±1 and J^...^ is an independent ran- 
dom variable following the Gaussian distribution 
iV(0, y)- We focus on the case p > 3. By calculat- 
ing [Z n ], we can write <j>(n) as 9 ) 

<t>(n) = £ Y!<f3 €(3 ~ \ Yl<{3 ^pq af 3 + C 

+ ±logTrexp [^ </3 q aP S a S^] ,(2.2) 

where q a p and q a p are determined by the saddle 
point equations of <j). By imposing the replica sym- 



metric (RS) ansatz, the solution is obtained as 
Mn;q,q) = £(n - \)<f> - ^qq + f + log 2 



-§ + i log /D U cosh" (V?") (2-3) 
with the saddle point equations 

/ Dm cosh™ (y/qu) tanh 2 (\/qu) 



jDu cosh 11 (y/qu) 



P 2 

q = Y pq ' 



,p-i 



(2.4) 



(2.5) 



where Dit represents the normalized Gaussian in- 
tegral. The RS solution is considered to be valid 
for a larger value of n and higher T. 

On the other hand, based on the 1RSB ansatz, 
the 1RSB solution is given as 

4>i(n;q a ,q ,qi,qi,m) = — {{n - m)q p + (m - l)gf } 
-\ {{n - m)q q + (m - l)qiq~i} + ^ + log2 - ^- 

n/m 



+ 



i log J D« jy Dv cosh m ( x/q^u + \Jq\- q v) 



. (2.6) 



To write the saddle point equations concisely, we 
define some averages as 

/Dwcosh" 1 Ef(v) 



(fh 



</)o 



/Di;cosh m S ' 

/ D« {/ F>v cosh m H}" /m f(u) 
jBu{jDvcosh m E} 



n/r. 



with S = \/qou + y/qi — qov. Then, the saddle 
point equations can be expressed as 

q = ((tanhS) 2 ) , q = t_ pq r-\ 2 .7) 



qi = ((tanh 2 s)i) 



5i = yWr(2-8) 
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(p-l)(^-«g)m=«logcoshS)i) --<log / Dz;cosh m S)o. 

Tfl J 

(2.9) 



3. Perturbation with Respect to n 

According to ref. 4, the 1RSB solution is valid 
for n = when the temperature is T G < T < T c , 
where T c is the paramagnetic-spin glass transi- 
tion temperature and Tq is the Gardner transi- 
tion temperature, 4 ^ which corresponds to 1RSB- 
full RSB transition temperature. This indicates 
that we have this relation [log Z] = lim„^ </>i ( n ) ■ 
Then, we assume that the 1RSB solution describes 
the behavior of the cumulant generating function 
in the vicinity of n = and perform the perturba- 
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tional analysis for the saddle point equations and 
the cumulant generating function itself. 

First, we consider the saddle point equations 
of qa(n) and <jo(n)(eq. (2.7)). The previous work 4 ) 
shows qo(0) = <?o(0) = 0, so we expand them as 



q (n) = a 1 n + a 2 n 2 + - 
q (n) = a^n + a 2 n 2 + ■ ■ 



(3.1) 



and determine their coefficients from its lower or- 
der of n. Expanding r.h.s. of the former equation 
of eq. (2.7) by \/qo, we see that its go dependence is 
expressed only as a function of ^/qo~u in the Gaus- 
sian integral. The leading term of the expansion 
of qo is found to start from the linear qg term by 
performing the integral. Then, the coefficient is 
a>i = aai because there are no singularities with 
respect to the other order parameters or the sad- 
dle point equation itself. By contrast, the latter 
equation of eq. (2.7) yields clearly a\ — because 
p — 1 > 2. It turns out that a\ = a\ = and this 
leads again to d 2 = a 2 = in a similar manner. 
Thus, we conclude inductively that = &k = 
for all k and qo(n) = qo(n) = 0. 

Substituting the result for q and qo in the 
0i (n), we have 

i(«;0,0,<7i,<7i,to) = Pl( m -i) q P - ±(m- l)qiqi 

+ £ + log 2 - § + i log/ T>v cosh m (V^i()3.2) 

Note that this expression is independent of n. Be- 
cause the order parameters q\ and q\ are deter- 
mined by minimizing <p\, they also lose the de- 
pendence on n. Consequently, we conclude that 
4>{n) = 0(0) in the vicinity of n = 0. 

Similarly, we can perform the perturbation 
with respect to r = T %7 T . In fact, when we substi- 

c 

tute r for n in eqs. (3.1), we can follow the above 
argument and conclude that qo(T,n) — qo( T , n ) = 
again. This implies that 4>{t, n) = 4>{t, 0) for any 
value of n < and in the vicinity of t = 0, which is 
consistent with the results shown in rcf. 10. In par- 
ticular, this means that </>(n) for n < is constant 
if r is sufficiently small and a discontinuous phase 
transition for q does not occur. To confirm this 
result, we examine the IRSB solution for p = 3 
and /3 = 3.0 numerically by the steepest descent 
method for the saddle point equations with respect 
to the order parameters. Figure 1 shows that it is 
certainly a constant function at least — 5 < n < 0. 

4. Connection between RS and IRSB so- 
lutions 

We have evaluated the cumulant generating 
function perturbativcly under the IRSB ansatz in 
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Fig. 1. n dependence of the cumulant generating function 
<p for RS(solid line) and lRSB(dashed line) solutions for 
p = 3 and (3 = 3.0. The full mark represents the AT 
instability point riAT- The inset shows an enlarged view 
around the minimum of the RS solutions. 



the previous section. This pcrturbative analysis 
would break down at a certain value of n as n 
increases from 0. To discuss a breaking point, we 
approach it from the RS solution, which is the cor- 
rect saddle point for n larger than 1 at least. 

The correct cumulant generating function (p 
generally has two analytic properties, monotonic- 
ity of <f) and convexity of ruj), which can be proven 
using Holder's inequality as shown in Appendix A. 
When one claims that an RS solution is valid at 
some value of n, the above two properties have to 
be maintained in addition to the AT stability. 3 ^ 
Therefore, we assume that the RS solution is valid 
if and only if these three properties hold. 

We examine whether the RS solution obtained 
using eq. (2.3) satisfies these properties. Let us 
first see the monotonicity. As shown in Fig. 1, it 
is clear that the monotonicity of the RS solution 
breaks down at some small positive value of n, 
which W6 Cclll 71 m (f3). This point is determined us- 
ing the equation 

dn dn dq dn dq dn dn 

The breaking point for other conditions is also de- 
termined using the equations 

d 2 0~ 



dn 2 







for the convexity and 
p(p - 1 



2„p-2 



/Dm cosh™ A \/qu 
J Du cosh™ \fqu 



(4.2) 



(4.3) 



for the AT stability. We define hat (/?) as the 
marginal solution of the AT stability condition. 
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It is shown later that the convexity is not bro- 
ken when we set parameters in the 1RSB stable 
regime. Therefore, we consider which of the break- 
ing points n m and uat is relevant. As an example, 
we show n m and hat for p = 3 as a function of the 
inverse temperature in Fig. 2. It is found that the 
two lines intersect with each other at an inverse 
temperature, which is denoted by 0g- We show 
later that this temperature (3g is the Gardner tem- 
perature. In the temperature region [3 < [3g, the 
monotonicity is first broken as n decreases. Thus, 
we conclude that 4>{n) — 4>q(ji) for n > n m in the 
1RSB stable temperature regime from the numeri- 
cal evidence and the assumption mentioned above. 

In other words, The above argument is that 
we take the RS solution to as small n as possible, 
while the 1RSB solution should be valid in the 
vicinity of n = 0. Then, we determine the cumu- 
lant generating function in the rest of the interval 
of n. It is, however, easily obtained by the follow- 
ing proposition that holds in general: 

Proposition 1 If (p'(n ) = for a value of n > 
0, then (j)(n) = (f)(0) for < n < n . 

The proof is given in Appendix A. Because we 
have <j>' (n m ) = in cq. (4.1) by definition, this 
proposition yields (j>(n) = 0o(O) for < n < n m . It 
should be noted that this fact is derived without 
the 1RSB solution or the perturbation but with 
the plausible assumption. 

Although the perturbation might not be nec- 
essarily required, we use it to understand intu- 
itively what is happening to the 1RSB solution. 
From the perturbational argument, the order pa- 
rameters turn out to be constant with respect to 
n. When we plot q(x, n) as a function of x with 
the value of n changing, the shape of q(x, n) is in- 
dependent of n as shown in Figs. 3(a) and 3(b). 
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Fig. 3(b). Schematics of q(x, n) for n < m (a) and n = m 
(b). 



Because the lower limit of the domain of q(x) is n, 
q(x) takes only one value q\ when n = m. This is 
how the 1RSB solution connects to the RS one as 
n increases from 0. 

We have discussed two continuations between 
the RS and 1RSB solutions. One is from the RS 
solution to the 1RSB one with n decreasing, which 
indicates that the connection point is n m . The 
other is from the 1RSB to the RS solutions with 
n increasing from 0, which indicates that it is m. 
Thus, this strongly suggests that n m — m. 

Let us compare the RS solution of eq. (2.3) to 
the 1RSB solution with q = of cq. (3.2). They 
have the same expression by identifying n with m, 
and q, q with qi,qi- By definition, n m and m give a 
minimal value of (f>o and <j)\ , respectively. Because 
the other order parameters are also determined 
by minimizing respective functions, we conclude 
that the RS solution at n — n m coincides with 
the 1RSB solution including the order parameters. 
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This yields certainly n m = m. 

We now turn to the convexity of n</>o, which 
is written as 



d 2 0o 
dn 2 



(») = 



( i M. M.\ 

y-> dn' dn J 



/ r)n2 



dndq 

a 2 0o 

dndq 



dndq 
9 2 0o 

9 2 0o 



a 2 0o 

dndq 

a 2 0o 

dqdq 
dUo 







1 






dn 1 






^ dn / 



>0. (4.4) 



From the correspondence mentioned above, the 
matrix in this inequality is the same as the Hes- 
sian of the 1RSB solution under the condition 
Qo = 9o = at n = 0. The matrix must be positive 
definite because of the stability of the 1RSB solu- 
tion in the parameter region /3 C < (3 < Pg- Then, 
we do not have to consider the convexity of the RS 
solution. 

Let us next show that the temperature at 
which the lines n m ((3) and u^riP) cross is the 
Gardner temperature. We have defined tiat as the 
solution of eq. (4.3) and have shown n m = m. Sub- 
stituting n m = m for n in cq. (4.3), we obtain that 
the equation is identical to the AT stability condi- 
tion of the 1RSB solution. 4 ) Therefore, it is shown 
that the AT stability condition of the RS solution 
at (/?, n TO (/3)) is equivalent to that of the 1RSB 
solution at (/3,0). This implies that the Gardner 
temperature is determined by the crossing tem- 
perature of n m (/3) and uat(P)- We note that the 
instability of the 1RSB solution is given by the 
analytic properties of the RS solution at a finite 
value of n. 

5. Calculation of Rate Function 

We have the cumulant generating function 
4>{n) for any value of n as 



4>{n) 



<f>o(n) (n > n m ), 

<t>i(n) = <j>o(n m ) (n<n m ), 



(5.1) 



although an explicit formula is not given. As an 
example, we show in Fig. 4 the cumulant gener- 
ating function evaluated numerically for p = 3. 
The function for the random energy model, corre- 
sponding to p — > oo in our model, is given rigor- 
ously as 11 ) 



lim 4>{n) 

p— KXD 



o (n) = fn+i^ (n>n m ), 
(j)\{n) = /?VTog2, (n < n m ) 



for [3 > (3 C . Thus, it is confirmed that <f>(n) is con- 
stant for n < from the three independent results, 
perturbation with respect to t, numerical calcula- 
tions, and the exact solution for p — > oo. 

By means of eqs. (1.3) and (5.1), the rate func- 
tion is derived in principle. Let us first evaluate 




Fig. 4. Cumulant generating function for p = 3 and (i 
3.0. 



the rate function for a small fluctuation around 
the thermodynamic value fo = lini/v^oo log Z . 
Noting that 4>{n m ) = <j>(0) = fo and (f>'(n m ) = 0, 
_ d ("0(")) a t n = n _|_ d n leads to 

+ dn) + (n m + dn)(j>'(n m + dn) 

= fo + n m <j>"(n m )dn + 0{dn 2 ), 

where df is a small and positive variable. Eventu- 
ally, we have 

1 



the equation / 
Jo + d/ 



dn 



(5.2) 



n m <j>"(n m ) 

and the rate function around fo is obtained as 

S(/o + df) = (n m + dn)(/ + df - ^{n m + dn)) 

= n m df. (5.3) 

Thus, we conclude that the rate function has a 
linear term with respect to the fluctuation around 
the thermodynamic value and its coefficient is n m . 
This is in contrast with the SK model with p = 2, 
where the leading term of E(/ + df) is anoma- 
lously (d/)( 6 / 5 ) 6 ) although other possibilities have 
also been discussed. It would be interesting to see 
that the finite value of the replica number n, which 
originates from RM, has a physical significance be- 
fore taking the limit of n to 0. 

The linear dependence of the rate function re- 
minds us of a structural similarity to the ther- 
modynamics. Rewriting the definition of 4>{n) and 
£(/), we have 



N Ai \ 1 1 

-_*(„)« --log 



exp 



-( 1») [ -ilogZ 



-JVE(/)wIogPr(-logZ«/ 



They can be regarded as the "free energy" and the 
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"entropy" , respectively, when we identify the true 
free energy — ^ log Z as the Hamiltonian. Then, fin 
is an effective "temperature" in this sense and eq. 
(5.3) is interpreted as "Td5 = d_E", because we 
use / as \ogZ and £(/o) = 0. Further comparison 
to thermodynamics is discussed in Appendix B. 

Let us complete the calculation of £(/). When 
/ < /o, £(/) = oo because <p(n) = <j>(0) for n < 0. 
When / ^> 1, £(/) i=a |— with a being some 
positive constant. This is because <j)(n) is approx- 
imately proportional to n with the coefficient a 
when n is sufficiently large. This property is de- 
rived from these inequalities: 2 ) 

[Z n ] > [exp(-n/?#i)] - exp (^Nn 2 ^j (5.4) 

where Hi is an energy value for a given configura- 
tion of {Si} and for n g N 

n 

[Z"HTr[exp(-]T/3!/( a ))] 

a=l 

ii<--'<ip \a=l / J 




Thus, for all n' E R, 4>{n') < <p(n + 1) < ^(n + 
f) + log2, where n is the largest integer which does 
not exceed n' . These imply that a = 

To fix the normalization factor AT, we intro- 
duce a characteristic value F of the free energy 
at which the expression of S(/) changes. For suf- 
ficiently large N, the probability distribution is 
expressed as (f.2) with £(/). Then, the normal- 
ization condition can be approximately written as 

1=/ dfAfe- Nn ™«-M + dfAfc~ Naf2 

Jo N J^ F y/N 

Because the second term is a Gaussian integral 
whose integral range does not include its peak, it 
vanishes exponentially as N increases. Then, we 
find that the leading term of AT is Nn m . By using 
this normalization factor, the mean of the fluctu- 
ation /o + df is evaluated as 

m - *b (5 - 6) 

Thus it decays as A^ -1 and this should be con- 
firmed numerically. 



6. Summary and Conclusions 

In this paper, we have calculated the cumu- 
lant generating function and the rate function of p- 
body Sherrington-Kirkpatrick model in the 1RSB 
temperature regime and argued the probabilistic 
property of the free energy log Z. 

We have evaluated the cumulant generating 
function by using RM with the replica number n 
finite from the two viewpoints. The perturbation 
analysis based on the 1RSB solution near n = 
indicates that the free energy and the order pa- 
rameters are constant as a function of n in the 
vicinity of n = 0. From the assumption that the 
RS solution is valid for n > n m when (3 < (}q, it 
follows that if we can take the RS solution down 
to n — n m , the cumulant generating function for 
< n < n m is determined uniquely as a constant 
function. 

Performing the Legendre transformation, we 
have evaluated the rate function, whose leading 
term near the thermodynamic value /o have been 
found to be S(/ + df) = n m df for < df < 1. 
This form is similar to the conventional thermody- 
namics if we regard the free energy as the "Hamil- 
tonian" . 

From these arguments, we have considered 
that the monotonicity breaking point n m is more 
relevant than the AT stability breaking point hat 
when the temperature is in the 1RSB regime. It 
is because the crossing point of n m and tt-at as a 
function of temperature is identical with the Gard- 
ner temperature at least in the model discussed. 
This criterion for determining the Gardner tem- 
perature is formally equivalent to that shown in 
rcf. 12, where a finite-temperature phase diagram 
of a coloring problem on a finite connectivity graph 
is discussed. We suppose that the monotonicity 
breaking explains the reason why the breaking pa- 
rameter m is determined "thcrmodynamically" . 

Furthermore, this is one of the possible mech- 
anisms of how an RS solution breaks to a 1RSB 
solution. Note that it is not based on the AT sta- 
bility breaking, but on the monotonicity break- 
ing. The latter case yields only the IRSB solution 
in principle. This scenario might explain why the 
RS solution breaks down only one step in many 
other models. In other words, the IRSB solution 
could be derived from the RS solution fixed as 
a monotonically increasing function. Thus, using 
this scheme, one may calculate the "IRSB" free 
energy even if the standard IRSB Parisi matrix 
is hardly constructed, which is the case in such 
models as finite- connectivity systems. 
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Appendix A: Proof of Proposition 1 

In the Appendix, we prove the proposition 1 
mentioned in §4. The proof relies on the following 
lemmas concerning the general properties of the 
cumulant generating function: 

(1) (monotonicity) <j>(n) is a monotonically in- 
creasing function in a broad sense. 

(2) (convexity) n<j)(n) is a convex function in a 
broad sense. 

Their proofs are as follows: From the Holder's 
inequality, we have for n < m 

[Z n ] = [Z m ^]<[Z m ]^. (A-l) 

From dividing the logarithm of both sides by nN, 
it follows that <pN{n) < <pN(m). In the limit N — > 
oo, the monotonicity is proven. 

From the Holder's inequality again, for s < t 
and < a < 1, we have 

< [Z s } a [Z t ] 1 - a . (A-2) 

In a similar manner, this leads to 

(as+(l— a)t)(f>N(as+(l— a)t) < as0jv(s) + (l 

In the limit N — ► oo, this proves the convexity. 
From the monotonicity, we have 

4>(n) < <j>(n ) (A3) 

for n < uq, while from the convexity, we have 

n<p(n) > (n a <p'(n a ) + <p(n ))(n - n ) + n <p(n ), 



rived in ref. 13 from the fact that the probability 
distribution function has to be normalizable. From 
this condition, the cumulant generating function 
4>(n) is restricted as 

d(n<f)(ri)) 



dn 



> <Mn), 



which is reduced to 



n<j)'(n) > 0. 

Thus, we see that the non- negativity of £(/) cor- 
responds to the monotonicity condition of 4>(n) for 
n > 0. 

This condition is a kind of "entropy crisis" , 
because £ can be interpreted as entropy induced 
by the randomness. We also consider the condi- 
tion imposed from the real entropy crisis S = 
(-ilogz) > , which is 

d 



P d/3 



where 



V>(/3,7) := 



— log[exp(- 7 F(/3))] 
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Note that the sign of |^ is not determined. In this 
sense, this paraphrase suggests that 7 = (3n is a 
more natural parameter than n. 



where the right-hand side represents the tangent 
line at n — n$. Because <p'(no) = 0, this inequality 
is reduced to n<p(n) > n<j){nn). It turns out that 
for n > 0, 



(j){n) > (j>{n ). 



The conditions (A-3) and (A-4) are satisfied simul- 
taneously only when 4>(n) = 4>(no). This completes 
the proof of the proposition. 



Appendix B: Entropy Interpretation 

Here, we comment on the non-negativity con- 
dition of the rate function, £(/) > 0, which is de- 
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